DOCUMENT BESUME 

IR 000 390 

Hornik # Robert C. 

Television, Background Characteristics and Learning 

in El Salvador*s Educational Reform* 

Stanford Univ., Calif. Inst, for Communication 

Research . 

Apr 74 

19p.; Paper presented at the American Educational 
Research Association Annual Meeting (Chicago, 
Illinois, April 15 through 19, 1974) 

MF-$0.75 HC-$1.50 PLUS POSTAGE 

♦Academic Achievement; *Background; Comparative 
Analysis; *Educationa 1 Change ; Educational 
Innovation; Family Characteristics; Grade 7; Grade 8; 
Grade 9; *Instructional Innovation ; ^Instruct icnal 
Television; Student Characteristics 
*El Salvador; Third Cycle; United States 



The use of instructional television (ITV) as part of 
an educational reform in grades 7, 8 and 9 El Salvador had a positive 
effect upon learning. This was achieved despite inequities in 
cognitive skills related to student background factors and inequities 
in resource distribution. In selected schools, 75* of the variance in 
cognitive skills in grade 7 could be predicted from background 
factors; this dropped to 66* after three years 1 participation in the 
reform program. In addition, students in reformed schools using ITV 
showed greater achievement than their counterparts in reformed 
schools without ITV. These results run counter to findings in the 
United States where background factors continue to dominate over 
innovations. There are at least three possible explanations. First, 
the El Salvador study used a longitudinal rather than a one-shot, 
cross-sectional approach. Second, ITV might have had a greater impact 
in El Salvador because it represented a larger and qualitatively more 
significant input to the system, relative to the previously existing 
levels of service. Finally, the ITV was of consistent guality, 
whereas innovations in the United States often vary in quality. 
(LB) 
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TELEVISION, BACKGROUND CHARACTERISTICS AND LEARNING IN 
EL SALVADOR'S EDUCATIONAL REFORM 



In the U.S., differences in school achievement between rich 
and poor, between suburban child and ghetto child, have not been 
significantly altered by increased investment in the schools of 
the disadvantaged. Rather, schooling has tended to widen gaps between 
rich and poor, or so the research seems to say (Coleman, 1966; Mos teller 
and Moynihan, 1972). While schooling obviously affects learning, 
such variations in schooling expenditures as exist do not. In contrast, 
in El Salvador, one innovation, an educational reform including 
instructional television, has had a significant incremental impact on 
learning. 

In 1969, with some help from the U.S. Agency for International 
Development and other outside organizations, the El Salvador Ministry 
of Education launched a maior educational reform. It included, for 
the seventh, eighth and ninth grades, curriculum reform, new student 
and teacher printed materials, bureaucratic reorganization, teacher 
retraining and television. 

Each classroom received from three to five 20 minute weekly 
broadcasts in each of the five basic subjects. Student workbooks 
provided conplementary text and exercises. Each teacher, many of whom 
were upgraded from primary school jobs, had been retrained for up to 
nine months in a subject specialty, pedagogical technique and 
utilization of television. 

Simultaneously, the newly reformed Third Cycle (as grades 
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seven to nine are called in El Salvador) opened its doors to many more 
students. Free tuition, double sessions and a higher student/teacher 
ratio permitted a tripling of enrollment in the public schools. 

While some critics have questioned the direction of the 
Reform, and others the adequacy of changes in some components, there 
can be little doubt that it represents a major restructuring. 1 
Hcwever, if the U.S. research is taken as a guide, such changes should 
have had little effect. Predictors such as individual ability and 
personal, family and conmunity background should have great importance, 
and variations in school quality relatively little. 

As will be seen, background characteristics are important, 
predicting student test scores as they entered seventh and as they 
left ninth grade. However, none of them were as important as the 
presence or absence of a + levision in the classroom in predicting 
change between those two times. The apparent differences between the 
El Salvador results and the U.S. results demand more extended 
discussion, and they will have it, as soon as the results have been 
presented. 

Description of the Study 

Data were gathered on 29 classes of students who began 
seventh grade in 1970 and finished ninth in 1972. Those classes, 
rather than the individual students in them, serve as the sampling 

1 For a more extensive account of the Reform and its effects, see 
Hornik et al., 1973. 
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and analysis units for this paper. The schools in which they studied 
were distributed across urban and rural areas, and were located in 
communities of differing wealth and development. Three types of 
variables were examined. 

Student variables 

During their three years in school students were administered 
General Ability and Reading tests and achievement tests in three 
subjects: mathematics, social studies and ocience,* Scores on these 
five tests at the beginning of seventh, beginning of eighth and the 
end of ninth grades were separately averaged by classroom and contained 
into cognitive skill indices.^ Thus each class was assigned three 
cognitive skills scores, one as it began Third Cycle, one for the 
beginning of eighth grade, and one as it finished Third Cycle. 

Each clas< //as also assigned the mean score of its members 
on personal and family background variables. These included wealth 
(based on family television ownership), father's education, mother's 

education, age, and proportion of students in the class who had 

• ■ * 

2\ Since ITV was distributed by classroom, its effect on within-class 
variance is likely to be very small and necessarily dependent on 
interaction with other variables. It is then reasonable, as well 
as required from a sampling theoretic perspective, to examine 
only between class variance in a study of ITV effect. 

3 Level 4 of the Spanish language versions of the Interamerican Series, 
prepared by Guidance Testing Associates of Austin, Texas, 

4 Tests prepared by the Educational Testing Service, Princeton, following 
the El Salvadoran curricula. 

5 Index weights reflected each test's loading on the principal 
factor of a factor analysis, 
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repeated a grade. Data for those variables were collected from as 
many as five paper and pencil questionnaires administered during the 
three years of Third Cycle • 

Community variables 

When these students were in eighth grade, an investigation 
of the characteristics of their schools and communities was undertaken. 
Through examination of public records, observation and interview, a 
broad range of data was collected and then reduced to manageable scales. 
Three scales were constructed from the corrcminity data. 

Educational availability was based on the opportunities in 
the comnunity for continuing post-Third Cycle schooling. Graduates of 
IS of the 29 schools could study either in Bachillerato (high school) 
or in a Carrera Corta (business course) without leaving their conmunities. 
Another eight schools were located within daily commuting distance of 
both types of post-Third Cycle education* However, graduates from six 
of the 29 schools who wished to continue their education needed to 
live away from home during the week. 

Ease of access to a large city, the second comnunity 
characteristics scale, was based on estimates of the time needed to 
travel by bus to the nearest large city and to the capital city. The 
final scale measured community resources . Five variables (presence 
of a bank, nunber of telephones per thousand population, percentage of 
paved streets, number of newspapers sold per thousand, and the presence 
of a factory in the comnunity employing more than SO persons) were 
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confcined into a single index. 

School variables 

Four indices were constructed to represent the range of 
information about schools. The first , school size , reflected the 
number of Third Cycle students in the school. Physical condition was 
the school director's general classification of his building 1 s 
condition as bad, or good, or in between. 

School directors also noted which of ten facilities their 
schools had: faculty library (10 schools had them) , student library (9) , 
a special room for a library (12), a science laboratory (5), inside 
plumbing (28) , space for recess (20) , an open field for physical! 
education (12) , an auditorium (8) , a telephone (14) , or a mimeograph 
machine (27). A school facilities Guttman scale was constructed from 
three of these, the presence of a faculty library, of a telephone land 
of a mimeograph machine. 

Finally, an index reporting the adequacy of teaching materials 
was constructed from directors' responses to a general question on 
sufficiency of materials, and to two questions about specific types 
of materials which were lacking. 

(Table 1 about here) i 
Interrelations among the Variabl es 

Almost all of these variables are closely related (Table 1). 

The children from the highest socioeconomic strata attend the best 

6 Once again weights were assigned according to loadings on the 
principal factor of a factor analysis, . .' 
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equipped schools in the most urban and wealthy communities, and they 
have the highest scores on the cognitive skills indices. The 
correlations were very high; some were over .70, and most were 
significant (p<.05), which, with only 29 classes in the sample, 
required a correlatipn greater than .31. They testify to how favored 
the advantaged children and schools were. All totalled, 75% of 
the variance (multiple r squared) in cognitive skills at the beginning 
of seventh grade could be predicted from these background and school, 
variables. 

What does this mean? Clearly, when El Salvadoran children 
arrive in seventh grade, what they know, and what skills they possess 
are profoundly affected by their backgrounds. If an observer knows 
class means of parent education and wealth, the average age of a 
child in the class , and rhaps something about the resources of the 
coninunity, he can go a lo, ^ way to predicting the level of cognitive 
skills likely to be found in that classroom. 

In addition, as this table of correlations illustrates, not 
only do children from advantaged homes and communities bring better 
skills to Third Cycle, but they are favored in the distribution of 
school resources as well. Teaching materials are less likely to be 
adequate, the physical condition of the school is likely to be poorer, 
and the facilities probably fewer in the rural school drawing poorer 
ents than in the city school with its higher SES students. Also 
teacher quality was not evaluated as a part of this survey, 
evidence indicated that this resource was distributed inequitably 
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as well. City schools were considered much more attractive places to 
work than were rural ones, and thus teachers with seniority and superior 
training and education gravitated to them. Into this context El 
Salvador introduced ITV, the first resource to be distributed universally 
and thus equally. 

There is no doubt that the skills with which students left 
Third Cycle were closely related to those with which they entered. 
About 55% of the variance in skills at the end of ninth grade was 
predictable from scores at the beginning of seventh. If one were to 
use all of the background information, with or without the cognitive 
index score from the beginning of seventh, to predict cognitive index 
scores at the end of ninth, it would account for 66% of the variance. 

However, recall that those background and school characteristics 
predicted some 751 of the variance in the seventh grade cognitive score. 
The drop (from 75 to 66) in predictive power means that not only was 
there an important change in the cognitive index over the three years, 
but it also indicates that the change was unrelated, or was negatively 
related, overall, to those background and school characteristics. 
Certainly the influence of background factors on skills was not 
eliminated; however, three years of schooling did result in some 
reduction of their importance. In contrast, U.S. research has suggested 
that background factors increase their absolute importance with additional years 
of schooling (Mosteller and Moynihan, p. 14). 

The Influence of ITV 

Of the 29 classrooms , three were located in the capital city. 

"o 
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All had ITV, and if kept in analyses of ITV's effects, they surely 
would have biased the results. Those classes were eliminated, leaving 
26 classes, 15 of which used ITV, 11 of which did not. All of these 
classes studied with the non-ITV components of the Reform (new 
curricula, student and teacher printed materials, retrained teachers, 
etc). Results reported here thus reflect conparisons between classes 
with the Reform and ITV and classes with the Refotm but without ITV. 

ITV was not assigned randomly within the sample; the political 
and administrative constraints of the school system did not permit that. 
However, the effort at matching subsamples proved quite successful. 

The 26 classes were ranked according to their scores on the 
cognitive index at the beginning of seventh grade and again on their 
scores at the end of ninth. The highest mean score among the classed 
received rank 1, th° second highest 2, and so on^own the line to 26. 

At the beginning of seventh grade, the ITV ?nd non-ITV 
subsamples achieved virtually identical mean ranks of 13.5. Thus the 
assignment of ITV to a class was apparently unrelated to cognitive 
skills. By the end of the three years of Third Cycle the situation 
had completely changed. The ITV mean rank at the end of ninth grade 
had risen to 10.1, while the non-ITV mean had fallen to 18.2. The 

7 There was some slight bias towards schools with ITV being in better 
physical condition than schools without, since one of the minimum 
criteria for having a TV receiver installed in the first years of 
the Reform was a secure and lockable building. It is not likely 
that this bias explains the apparent influence of ITV on learning. 
Physical condition correlated with learning, but less so than did 
presence of ITV, In addition, the fact that other school quality 
variables were unrelated to learning would indicate that the physical 
condition/learning relation was a spurious one resulting from their 
coimwh relation to presence of ITV. 



ITV classes had far outperformed the non-ITV classes. 

It should be recalled that given IS ITV classrooms out of a 
total of 26 classrooms, the best mean rank that the ITV classes could 
have achieved was 8,0, and that only if they had occupied ranks 1 to 
15. Conversely, if tho 11 non-ITV classes had occupied ranks 16-26, 
they would have reached their minimum mean rank of 21.0. Given these 
maximum and minimum levels, the amount of change that did occur was 
quite large and statistically significant (Table 2) . 

(Table 2 about here) 

From another perspective, out of the 15 ITV classes, 11 
(or 73%) moved up in rank between the beginning and end of Third 
Cycle. Of the 11, non-ITV classes, only two (or 18%) moved up in rank. 
In fact there was no other community, school or background variable 
which had as strong an effect on change in the cognitive index as 
did membership 'non < N jnl; 'ship in an ITV class. 

Table 3 reports Pearson correlations between each of the 
conrtunity, school and background variables, membership in an ITV 
classroom, on the one hand, and cognitive index scores (beginning of 
seventh, end of ninth, change between those times) cn the other. The 
correlations of the predictor variables with the cognitive indices 
differ from those reported in Table 1 because the three capital city 
ITV classes were eliminated. 

(Table 3 about here) , 
At the beginning of seventh grade membership in an ITV class 
was a non-significant predictor of cognitive skills. Of the other ten 
predictor variables, nine had larger correlations with the index. In 
contrast, at the end of ninth grade only two other predictors (wealth 
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and age) had larger bivariate correlations with the cognitive index. 
None of the other variables was a better predictor of change on the 
index over the three grades. Only one other variable, father's 
education, was even a significant (p<.05) f predictor of cognitive skills 
change, and it was a negative predictor. 

Discussion 

The results seem unequivocal. The investment in ITV 
significantly affected learning and reduced the quite awesome influence 
on cognitive skills of background and comnunity factors and their 
correlate, the skills students bring to their seventh grade classroom. 
Why did this study produce such strikingly different results from 
U*S» investigations? There are several considerations which may explain 
the differences. 

It is clear that here are important methodological differences 
between much of the U.S. literature and the El Salvador studies. The 
former are by and large surveys, one shot cross -sectional investigations 
of a large nunfcer of schools. The latter was a quasi -experimental three 
year panel study of a small sanple of schools. However, even if the 
El Salvador studies had been limited to , survey of the 26 classes as 
they finished ninth grade, the conclusions would have been the same, 
essentially those which can be derived from the second column of Table 3. 
The decline in importance of background factors might have been missed, 
and the inferences about ITV 1 s influence on chajige in cognitive skills 
would have depended on assumptions rather than evidence that the 
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original distribution of cognitive skills was unrelated to assignment 
to an ITV class. Nonetheless the contradiction between the U.S. and 
Salvadoran results would have remained. 

In fact, the reasons for the differences are likely substantive 
rather than methodological in origin. One involves the difference in 
respective starting points of the two school systems. There can be 
little doubt that the minimum levels of teacher quality (at least as 
measured by education, training, and knowledge of pedagogical technique) 
and of school facilities in the U.S. were superior to their maximum 
levels in El Salvador. In El Salvador per capita student expenditure 
was in the range of $75-100; U.S. expenditure per student is more 
than 10 times that. Even excluding the portion of the large teacher 
salary differential unrelated to qualification, the gap between the 
level of expenditure of the two systems is cavernous. 

Given the :;.S. customary level of expenditure, new investments, 
or variations in Investment between central city and suburb of the 
same state, may be of minor inportance. As a percentage of total - 
expenditure they may be small. Or there may be a plateau effect on 
investment. The marginal return on additional investment given a 
high pre-existing level of expenditure m / be small. 

In El Salvador, in contrast, ITV was a significant investment. 
It may account for 2S% of the instruction cost of each student. Of 

— ;/ : r : . : " - 

8 See Homik et al., 1973, pp. 198-242 for details. This was largely 
a substitute for, rather than an add-on to, 'teacher expenditures, 
as a result of manipulations of student hours, teacher hours and 
salaries , and class size. 



12 . 



n»re importance, qualitatively it loomed much larger in the poorly 
equipped and less well staffed El Salvadoran classroom, than a similar 
innovation would have in the U.S. One explanation then for the 
difference between U.S. and El Salvadoran results is qualitative 
inport of each of the innovations relative to the starting points of 
their respective school systems. 

A second reason for the contrasting findings may reflect 
differences in consistency of the quality of innovations investigated. 
A particularly instructive comparison can be made with the Westinghouse 
(1969) evaluation of the head start pre-school programs. Overall, it 
was suggested, such programs had not achieved their ends. The 
inference to be drawn was that investment in this area did now show a 
sufficient return and should be reduced or dropped. However, two 
reviewers (Smith and Bissell, 1970) noted that among the programs 
studied there wore some notable successes. They implied that the proper 
inference was not Mat the funding should end, but rather that an 
effort be made to uncover the reasons for success and failure, so that 
the successful projects might be copied. 

Similarly, the Coleman survey lunped together a wide variety 
of quantitatively equal but qualitatively different educational 
expenditures and found them on the average ineffective. The El 
Salvador evaluation examined one type of investment, one of significant 
quality, and found it effective. It suggests that while indiscriminate 
spending will not achieve results, investment in some innovations may. 

A* a final note, the substance of the findings should be 
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carefully restated. Instructional television, despite existing 
inequities in cognitive skills related to background and correlated 
inequities in school resource distribution, affected learning in an 
important way. To avoid misinterpretation, it should be stated clearly 
that this does not imply that ITV, applied throughout a school system 
has the potential for redressing those inequities. In this particular 
research context, when some schools had ITV and some did not, there 
was some reduction in the importance of background influences. 
However, this, as far as the present evidence is concerned, was a 
function of differential application of ITV; classes of poorer children 
with ITV improved more than some classes of wealthier children without 
it. If ITV had been applied universally (as it is at present) there 
should be no expectation that poorer children will benefit from it 
more or less than wealthier ones.** 



9 In Hornik et al., 1973, pp. 40-46, however, evidence is presented 
which suggests that among non-ITV classes the general ability gap 
between urban and rural students was opening during the three years 
of third Cycle, while among ITV rural and urban students the gap 
neither opened nor closed. At the same time, in both ITV and non- 
ITV classrooms, gaps between male and female students, and between 
younger arid older students in a classroom (age reflecting the tendency 
id enter schdol late arid/or miss or repeat a year) opened during the 
Third Cycle years. 
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Table 2 

COGNITIVE SKILLS AND METHOD OF INSTRUCTION 
COHORT B, BY CLASSROOM 
(N = 26) 



Mean Ranks 



Cognitive Measures 

Cognitive Index (7th Beginning) 
Cognitive Index (9th End) 



ITV 
13.53 
10.07* 



No ITV 

13.45 

18.18* 



* Difference sig. at (p<.02) on Mann Whitney U Test 



0 

ERIC 



Table 3 



CORRELATIONS: PREDICTOR VARIABLES, USE OF INSTRUCTIONAL 
TELEVISION, AND COGNITIVE INDEX SCORES 
(N » 26 SCHOOLS OUTSIDE OF CAPITAL CITY) 





Cognitive 
Index 

Beginning 7th 


Cognitive 
Index 
End 9th 


Change on 
Cognitive 
Index 7th 
to 9th Grades 


Father* s Education 


.75 


.41 


-.41 


Wool +\y 




^7 
• •> i 




Age 


-.47 


-.63 


- • 12 


Repeated Grade (0 = No, l*Yes) 


-.32 


-.31 


.04 


Community Resources 


.49 


.36 ^ 


-.38 


School Size 


.34 


.38 


.01 


Adequacy of Teaching Materials 


.03 


.09 


.06 


Educational Opportunity 


.32 


.20 


-.15 


Ease of Access to City 


.30 


.24 


-.09 


Physip^L Condition of School 


.14 


.43 


.28 


ITV (0 a No , l*Yes) 


.07 


.52 


.45 
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